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(54) 3-D MODEL PROVIDING DEVICE 



(57) A three-dimensional model providing appara- 
tus in which a customer can easily modify the input 
three-dimensional data. The apparatus comprises an in- 
put section (10) for inputting three-dimensional data, a 
server section (12) for managing the processes on the 
three-dimensional data from input to output, a providing 
section (14) for providing three-dimensional data, a 



communicating section for communicating the three-di- 
mensional data between the input section, server sec- 
tion, and providing section, a receiving section (11) for 
receiving instruction contents from the customer, and a 
converting section (13) for modifying, processing, or 
converting the three-dimensional data according to the 
instruction contents. 
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Description 

Technical Field 

[0001] The present invention relates to a three-dimen- 
sional model providing apparatus for capturing an image 
of a target, generating a three-dimensional model of the 
target, and providing the data to a customer in a desired 
content. 

Background Art 

[0002] For some years, three-dimensional scanners 
which can be used to obtain three-dimensional shape 
data and color information of various types of objects 
have been known. Various software for capturing the 
thee-dimensional data into a computer and converting 
it to a desired data format are also available. It is also 
known to output onto a desired recording medium and 
communicate via a network using peripheral devices of 
a computer. 

[0003] However, because many of the three-dimen- 
sional scanners are large and expensive, they represent 
a major investment to purchasers, who general pur- 
chase a three-dimensional scanner for a special pur- 
pose. There has, therefore, been no means for ordinary 
users to scan or obtain three-dimensional data. Moreo- 
ver, among the three-dimensional scanners, a method 
for obtaining three-dimensional shape data by scanning 
laser light onto a target in particular requires a long pe- 
riod of time for scanning and requires the object to be 
still for the entire duration of that scanning period. Be- 
cause of this, it was difficult to obtain three-dimensional 
data of, for example, a living human being or other Irving 
or animated target. 

[0004] Moreover, it is not always safe to irradiate laser 
light onto a person. 

[0005] Furthermore, when a customer wishes to mod- 
ify the input three-dimensional data, there has hereto- 
fore existed no system for the customer to easily trans- 
mit the three-dimensional data along with a modification 
request (desire) of the customer to a specialized modi- 
fication processor. 

Disclosure of The Invention 

[0006] The present invention was conceived to solve 
the above described problem and one object of the 
present invention is to provide a three-dimensional mod- 
el providing apparatus which enables a general custom- 
er to freely create and use a three-dimensional model. 
[0007] In order to achieve the object above, according 
to one aspect of the present invention, there is provided 
a three-dimensional model providing apparatus for sup- 
plying three-dimensional data of a target to a customer, 
the apparatus comprising an input section for inputting 
three-dimensional data; a server section for managing 
the three-dimensional data; a providing section for pro- 



viding the three-dimensional data; and a communicating 
section for transceiving the three-dimensional data be- 
tween the input section, server section, and providing 
section. 

5 [0008] According to another aspect of the present in- 
vention, it is preferable that the three-dimensional model 
providing apparatus further comprises a receiving sec- 
tion for receiving instruction contents from the customer; 
and a converting section for modifying, processing, or 

10 converting the three-dimensional data based on the in- 
struction contents. 

[0009] According to another aspect of the present in- 
vention, it is preferable that the three-dimensional model 
providing apparatus further comprises an output section 
15 for confirming, visually or by audio, the input three-di- 
mensional data or modified or processed three-dimen- 
sional data. 

[001 0] According to another aspect of the present in- 
vention, it is preferable that the output section is capable 

20 of three-dimensional display. 

[001 1 ] According to another aspect of the present in- 
vention, it is preferable that the input section produces 
three-dimensional shape data based on image data of 
the target captured from a plurality of directions. 

25 [001 2] According to another aspect of the present in- 
vention, it is preferable that the input section produces 
color data associated with the three-dimensional shape 
data based on image data of the target captured from a 
plurality of directions. 

30 [0013] According to another aspect of the present in- 
vention, it is preferable that the input section produces 
three-dimensional shape data based on image data of 
the target captured from a plurality of directions by a plu- 
rality of cameras. 

35 [0014] According to another aspect of the present in- 
vention, it is preferable that the input section produces 
color data associated with the three-dimensional shape 
data based on image data of the target captured from a 
plurality of directions by a plurality of cameras. 

40 [0015] According to another aspect of the present in- 
vention, it is preferable that the input section includes a 
light irradiating section for irradiating light onto the tar- 
get. 

[001 6] According to another aspect of the present in- 
45 vention, it is preferable that the input section comprises 
a light projection section for projecting light; a light re- 
flecting section for reflecting light incident from the light 
projection section and projecting onto the target; a light 
receiving section for receiving fight projected onto the 
so target and reflected therefrom; and a modeling section 
for producing three-dimensional data of the target based 
on the received light data. 

[0017] According to another aspect of the present in- 
vention, it is preferable that the light projection section 
55 is a surface light source for projecting a pattern light. 
[0018] According to another aspect of the present in- 
vention, it is preferable that the input section comprises 
a light projection section for projecting light onto the tar- 
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get; a target image reflecting section for further reflect- 
ing light projected onto the target and reflected there- 
from; a light receiving section for receiving the target im- 
age reflected at the target image reflecting section; and 
a modeling section for producing three-dimensional da- 
ta of the target based on the received light data. 
[0019] According to another aspect of the present in- 
vention, it is preferable that the instruction content from 
the customer received at the receiving section is a data 
format used when the three-dimensional data is provid- 
ed by the three-dimensional model providing apparatus. 
[0020] According to another aspect of the present in- 
vention, it s preferable that the instruction content from 
the customer received at the receiving section is modi- 
fication and processing content to be applied to the 
three-dimensional data by the three-dimensional model 
providing apparatus. 

[0021 ] According to another aspect of the present in- 
vention, it is preferable that the instruction content from 
the customer received at the receiving section is a data 
providing method designating the providing method of 
the three-dimensional data by the three-dimensional 
model providing apparatus. 

[0022] According to another aspect of the present in- 
vention, it is preferable that the receiving section com- 
prises a received content output section for outputting 
the instruction content from the customer and the iden- 
tification information for identifying the customer. 
[0023] According to another aspect of the present in- 
vention, it is preferable that the received content output 
section comprises one of a display-at-display section, 
an output-by-printing section, and an output-to-record- 
ing-medium section. 

[0024] According to another aspect of the present in- 
vention, it is preferable that the converting section con- 
verts the three-dimensional data according to the data 
format. 

[0025] According to another aspect of the present in- 
vention, it is preferable that the converting section mod- 
ifies, processes, or converts the three-dimensional data 
according to the modification and processing contents. 
[0026] According to another aspect of the present in- 
vention, it is preferable to manage operation progress 
condition of the providing section and the converting 
section, in addition to managing the three-dimensional 
data. 

[0027] According to another aspect of the present in- 
vention, it is preferable that the three-dimensional model 
providing apparatus further comprises a communicating 
section, and the apparatus communicates, via the com- 
municating section, the three-dimensional data, the in- 
struction content from the customer, and identification 
information for identifying the customer to/from another 
three-dimensional model providing apparatus having a 
function equivalent to the converting section. 
[0028] According to another aspect of the present in- 
vention, it is preferable that the three-dimensional model 
providing apparatus furthercomprises a communicating 



section, and the apparatus communicates, via the com- 
municating section, three-dimensional data, instruction 
contents from the customer, and/or identification infor- 
mation for identifying the customer to/from another 

s three-dimensional model providing apparatus having a 
function equivalent to the providing section. 
[0029] According to another aspect of the present in- 
vention, it is preferable that the providing section com- 
prises a recording medium selecting section capable of 

10 selecting an arbitrary recording medium from among at 
least one type of recording medium which are provided 
to the three-dimensional model providing apparatus in 
advance, and a recording medium writing section for 
writing three-dimensional data onto the recording medi- 

15 um. 

[0030] According to another aspect of the present in- 
vention, it is preferable that the providing section com- 
prises a recording medium writing section for writing the 
three-dimensional data onto a recording medium pre- 

20 pared by the customer. 

[0031 ] According to another aspect of the present in- 
vention, it is preferable that the providing section com- 
prises recording medium mailing means for mailing the 
recording medium. 

25 [0032] According to another aspect of the present in- 
vention, it is preferable that the providing section sends 
the three-dimensional data to a providing section of an- 
other three-dimensional model providing apparatus via 
the communicating section. 

30 [0033] According to another aspect of the present in- 
vention, it is preferable that the other three-dimensional 
model providing apparatus is an apparatus designated 
by the customer (referred to as a "designated appara- 
tus" hereinafter). 

35 [0034] According to another aspect of the present in- 
vention, it is preferable that the other three-dimensional 
model providing apparatus is a database server for 
managing access by the customer, in addition to accu- 
mulating and managing the three-dimensional data. 

40 [0035] According to another aspect of the present in- 
vention, it is preferable that the three-dimensional data 
and unique information of the customer are communi- 
cated to/from the designated apparatus based on the 
data providing method. 

45 [0036] According to another aspect of the present in- 
vention, it is preferable that the designated apparatus is 
capable of adding new information to the unique infor- 
mation. 

[0037] According to another aspect of the present in- 
50 vention, it is preferable that the designated device is an 
entertainment device. 

[0038] According to another aspect of the present in- 
vention, it is preferable that the designated apparatus is 
an entertainment device and the new information is the 
55 score evaluated by the entertainment device as a result 
of the entertainment. 

[0039] According to another aspect of the present in- 
vention, it is preferable that the designated apparatus is 
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an entertainment device and the new information is in- 
formation for updating the three-dimensional data itself. 
[0040] According to another aspect of the present in- 
vention, it is preferable that the three-dimensional model 
providing apparatus further comprises an information 
re-inputting section for rereading the information with 
the new information added at the designated apparatus. 
[0041 J According to another aspect of the present in- 
vention, it is preferable that the designated apparatus is 
an entertainment device and the three-dimensional data 
recorded in the recording medium is used by an enter- 
tainment program of the entertainment device. 
[0042] According to another aspect of the present in- 
vention, it is preferable that the designated apparatus is 
a database section and manages the input three-dimen- 
sional model and entertainment program. 
[0043] According to another aspect of the present in- 
vention, it is preferable that the server section reads a 
model template of entertainment characters from the 
database section , and the input three-dimensional mod- 
el is changed at the converting section based on the 
character model template. 

[0044] According to another aspect of the present in- 
vention, it is preferable that the server section reads an 
entertainment program from the database section, and 
the input three-dimensional model is incorporated into 
the entertainment program at the converting section. 
[0045] According to another aspect of the present in- 
vention, it is preferable that there exist a plurality of en- 
tertainment devices. 

[0046] According to another aspect of the present in- 
vention, it is preferable that the plurality of entertainment 
devices are capable of communicating with each other. 
[0047] According to another aspect of the present in- 
vention, it is preferable that the designated apparatus is 
a device connected to a network including a computer. 
[0048] According to another aspect of the present in- 
vention, there is provided a three-dimensional model 
providing apparatus forsupplying three-dimensional da- 
ta of a target to a customer, the apparatus comprising 
an input section for inputting two-dimensional image da- 
ta; a producing section for producing three-dimensional 
data from the two-dimensional image data; a server sec- 
tion for managing the three-dimensional data from input 
to output; a providing section for providing three-dimen- 
sional data; and a communicating section for communi- 
cating the three-dimensional data between the input 
section, producing section, server section, and provid- 
ing section. 

[0049] According to another aspect of the present in- 
vention, it is preferable that the two-dimensional image 
data is at least one portion of the target image data. 
[0050] According to another aspect of the present in- 
vention, it is preferable that the two-dimensional image 
data is image data captured in accordance with a meth- 
od for automatically producing three-dimensional data. 
[0051 ] According to another aspect of the present in- 
vention, it is preferable that the communicating section 



is capable of communicating with an external network. 
[0052] According to another aspect of the present in- 
vention, there is provided a three-dimensional model 
providing apparatus for supplying a three-dimensional 

5 model to a customer, the three-dimensional model ob- 
tained by combining at least two three-dimensional 
models, the apparatus comprising a database section 
capable of recording at least one three-dimensional 
model data; a controlling section for controlling the se- 

10 lection of three-dimensional model data recorded at the 
database section and the interface with a user; a data 
integrating section for integrating the selected three-di- 
mensional model data; and a display section for display- 
ing the three-dimensional model data. 

is [0053] According to another aspect of the present in- 
vention, it is preferable that the data integrating section 
changes the shapes of at least two three-dimensional 
model data to be integrated and then integrates the da- 
ta. 

20 [0054] According to another aspect of the present in- 
vention, it is preferable that the three-dimensional model 
providing apparatus further comprises a color changing 
section for changing color of the selected three-dimen- 
sional mode! data. 

25 [0055] According to another aspect of the present in- 
vention, it is preferable that the display section is a dis- 
play apparatus capable of three-dimensional display. 
[0056] According to another aspect of the present in- 
vention, it is preferable that the three-dimensional model 

30 providing apparatus further comprises a communicating 
section capable of communicating with a database sec- 
tion via a network, and the three-dimensional model da- 
ta is recorded in the database section. 
[0057] According to another aspect of the present in- 

35 vention, it is preferable that a plurality of three-dimen- 
sional model data recorded at the database section are 
read and the read three-dimensional model data are in- 
tegrated to produce three-dimensional data. 
[0058] According to another aspect of the present in- 
vention, it is preferable that the three-dimensional model 
providing apparatus further comprises an optional func- 
tion display section for allowing a customer to select an 
optional function. 

[0059] According to another aspect of the present in- 
45 vention, it is preferable that the three-dimensional model 
providing apparatus further comprising a three-dimen- 
sional data modifying section for modifying the input 
three-dimensional data based on the selected optional 
function. 

so [0060] According to another aspect of the present in- 
vention, it is preferable that the optional function adds a 
pair of glasses to the input three-dimensional data. 
[0061 ] According to another aspect of the present in- 
vention, it is preferable that the optional function chang- 

55 es the hair style of or adds hair to the input three-dimen- 
sional data. 

[0062] According to another aspect of the present in- 
vention, it is preferable that the optional function assigns 
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a color to each section. 

[0063] According to another aspect of the present in- 
vention, it is preferable that the optional function adds 
an ornament to the input three-dimensional data. 
[0064] According to another aspect of the present in- s 
vention, it is preferable that the optional function chang- 
es the shape proportion of the three-dimensional data. 
[0065] In order to achieve the object described above, 
according to another aspect of the present invention, 
there is provided a three-dimensional model providing 
method for supplying three-dimensional data of a target 
to a customer, the method comprising the steps of in- 
putting three-dimensional data; managing the three-di- 
mensional data at a server section; providing the three- 
dimensional data at a providing section; and transmit- 
ting/receiving the three-dimensional data between the 
input section, server section, and providing section, via 
a communicating section. 

[0066] According to another aspect of the present in- 
vention, it is preferable that the three-dimensional model 
providing method further comprises a step of receiving 
instruction contents from the customer at a receiving 
section, and a step for modifying, processing, or con- 
verting the three-dimensional data based on the instruc- 
tion contents at a converting section. 
[0067] According to another aspect of the present in- 
vention, it is preferable that the three-dimensional model 
providing method further comprises the step of confirm- 
ing, visually or by audio, the input three-dimensional da- 
ta or modified or processed three-dimensional data at 
an output section. 

[0068] According to another aspect of the present in- 
vention, it is preferable that the output section performs 
three-dimensional display. 

[0069] According to another aspect of the present in- 
vention, there is provided a three-dimensional model 
providing method for supplying three-dimensional data 
of a target to a customer, the method comprising the 
steps of inputting two-dimensional image data; produc- 
ing three-dimensional data from the two-dimensional 
image data; managing the three-dimensional data from 
input to output at a server section; providing three-di- 
mensional data at a providing section; and transmitting/ 
receiving the three-dimensional data between the input 
section, producing section, server section, and provid- 45 
ing section, via a communicating section. 
[0070] According to another aspect of the present in- 
vention, it is preferable that the two-dimensional image 
data is at least one image data of the target. 

so 

Brief Description of Drawings 
[0071] 

Fig. 1 is a block diagram showing a structure of one 55 
embodiment of the present invention. 
Fig. 2 is a block diagram showing a structure of the 
input section shown in Fig. 1 . 



Fig. 3 is a conceptual diagram showing a structure 
of the input section. 

Fig. 4 is a block diagram showing a structure of the 
receiving section shown in Fig. 1 . 
Fig. 5 is a block diagram of a flow of a recording 
medium at the providing section. 
Fig. 6 is a block diagram showing a flow of three- 
dimensional data at the providing section. 
Fig. 7 is a block diagram showing a structure when 
three-dimensional data is used with an entertain- 
ment device or the like. 

Fig. 8 is a block diagram showing a structure when 
three-dimensional data is produced from two-di- 
mensional image data. 

Fig. 9 is a block diagram showing a structure for re- 
alizing an integration function of three-dimensional 
data. 

Fig. 1 0 is a diagram showing calibration. 
Fig. 11 is a diagram showing a structure for project- 
ing a random pattern. 

Fig. 12 is a diagram showing an example of a ran- 
dom pattern. 

Fig. 13 is a diagram showing a structure of a three- 
dimensional data producing apparatus according to 
another embodiment of the present invention. 
Figs. 14(a) and (b) are diagrams explaining posi- 
tions of an illumination light source. 
Figs. 15(a) and (b) are diagrams explaining a laser 
irradiating device. 

Figs. 1 6(a) and (b) are diagrams explaining camera 
positions for avoiding blind spots. 
Fig. 1 7 is a diagram showing a structure of a three- 
dimensional data producing apparatus according to 
another embodiment of the present invention. 
Fig. 1 8 is a diagram showing a flow of data input. 

Best Mode for Carrying Out the Invention 

[0072] Embodiments of the present invention will now 
be described referring to the drawings. Fig. 1 shows a 
structure of a three-dimensional model providing appa- 
ratus according to one embodiment of the present in- 
vention. 

[0073] A three-dimensional data input section 1 0 cap- 
tures an image of a target such as a person or the face 
of a person, and produces three-dimensional data. The 
three-dimensional data input section 1 0 may be, for ex- 
ample, a three-dimensional data inputting apparatus as 
shown in Figs. 2 and 3. An image data input section 20 
captures an image of the target and produces image da- 
ta. The image data input section 20 includes a plurality 
of fixed color CCD cameras, as shown in Fig. 3, and 
obtains color image data of the target at a plurality of 
different positions. 

[0074] In the following descriptions, the term "three- 
dimensional shape data" refers to data of the three-di- 
mensional shape information of the target, and may, in 
some cases, include the color information. The three- 
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dimensional shape data is obtained by inputting an im- 
age at the data input section and performing a modeling 
process at a modeling section. When the data input sec- 
tion is a three-dimensional shape measurement device, 
the three-dimensional shape data may be obtained at s 
the data input section. Moreover, data which is obtained 
by changing, modifying, integrating, and/or processing 
the obtained three-dimensional shape data is also re- 
ferred to as three-dimensional shape data. 
[0075] The color image data, including the color infor- 10 
mation, obtained by the image data input section 20 is 
input to a modeling section 21 . The modeling section 21 
includes a computer or the Nke, and performs three-di- 
mensional modeling based on the plurality of image data 
of the target captured at the plurality of different posi- is 
tions, to obtain three-dimensional data of the target. The 
three-dimensional data includes the color data of the tar- 
get. For the three-dimensional modeling, any method 
can be used such as, for example, a method disclosed 
in Japanese Patent Laid-Open Publication No. Hei 20 
10-124704. 

[0076] A display/output section 15 displays/outputs, 
visually or by audio, input three-dimensional data, con- 
firmation of the reception process and reception content 
at a receiving section 11 , confirmation of the three-di- 25 
mensional data after processing at a converting section 
13, and information at a providing section 14 (to be de- 
scribed later). The display of the three-dimensional data 
is possible using a display which is capable of three- 
dimensional display. 30 
[0077] As shown in Fig. 4, the receiving section 11 in- 
cludes one of a data format receiving section 40 for re- 
ceiving a data format to be used when three-dimension- 
al data is provided to the customer from the three-di- 
mensional model providing apparatus, a modification 35 
process content receiving section 41 for receiving the* 
content of the modification processing of the data when 
providing the three-dimensional data, and a providing 
method receiving section 42 for receiving the method 
for providing the three-dimensional data, and a received 40 
content output section 43 for outputting the received 
contents and customer identification information re- 
quired when providing the data. The received content 
output section 43 includes a display-at-display section, 
an output-by-printing section, and an output-to-record- 45 
ing-medium section. The display-at-display section can 
also be a display section 1 5. 

[0078] The data format at the data format receiving 
section 40 can be, for example, general three-dimen- 
sional model description format, a game compatible for- so 
mat which can be input into a game program, a network 
compatible format where data amount is compressed 
for network communication, or a security compatible for- 
mat used for personal authentication. When a security 
compatible format is selected, personal information of 55 
the customer is received and the three-dimensional data 
including the personal information is provided. In such 
a case, it is preferable to not only encrypt the three-di- 



mensional data of the target, but also to include the per- 
sonal information for encryption. 
[0079] The modification process content receiving 
section 41 designates the content of the modification 
processing desired by the customer such as, for exam- 
ple, modification of the input three-dimensional data for 
better looks, deformation of the input data so that the 
characteristics are emphasized, or modification of the 
input data so that it is more animation-like. 
[0080] At the providing method receiving section 42, 
the customer designates the method for providing the 
input three-dimensional data to the customer. Examples 
of such methods include a recording medium prepared 
at the three-dimensional model providing apparatus in 
advance and a recording medium prepared by the cus- 
tomer. In this case, because the a great variety of re- 
cording mediums are currently in use, it is preferable 
that the type of the input recording medium be detected 
automatically. It is also possible to provide the recording 
medium to the customer by mail. In this case, the des- 
tination information such as the address to which the 
medium is to be mailed is also received. 
[0081] In addition, there also exists a method for di- 
rectly transferring to the computer or the mobile terminal 
(for example, PDA, PHS, or portable phone) that the 
customer possesses, using communication means. In 
this case, the type of communication (protocol) and in- 
formation of the communication destination (address) 
are received. 

[0082] Moreover, there also exists a method for pro- 
viding the three-dimensional data to the customer by 
transferring the data to a server on a network and allow- 
ing the customer to access the server. In this case, iden- 
tification information such as a number or a password 
for identifying the customer when accessing can be re- 
ceived or issued at a providing section 14 of the three- 
dimensional model providing apparatus. 
[0083] A server section 1 2 manages the data from in- 
put to output of the three-dimensional data, schedules 
the processes, and/or prepares data suited for the meth- 
od for providing the three-dimensional data to the cus- 
tomer. 

[0084] The converting section 1 3 includes at least one 
of a modification processing section for modify process- 
ing according to the content designated by the customer 
at the modification process content receiving section 41 
or a data converting section for converting the three-di- 
mensional data to be provided into a data format re- 
ceived from the customer at the data format receiving 
section 40. The converting section 13 can be placed 
within the three-dimensional model providing apparatus 
or within a three-dimensional model providing appara- 
tus located at a different location by communication 
means such as a network, in which case the three-di- 
mensional data is transmitted via communication. The 
apparatus at different location in this case can be a serv- 
er, in which case, a particular processing operator ac- 
cesses the server, transmits and receives data, and 
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processes the data. Moreover, the modification 
processing section and the data converting section can 
also be independently provided. In such a case, it is pref- 
erable to allow the data to be interchanged by a network 
or a recording medium. 

[0085] Fig. 5 shows a sequence of processes at the 
providing section 14 such as writing the three-dimen- 
sional data onto the recording medium. 
[0086] A desired recording medium is selected at a 
recording medium selecting section 51 from among re- 
cording media pre-provided at a recording medium stor- 
ing section 50. The final data is written onto the selected 
recording medium at a three-dimensional data writing 
section 52. By outputting the recording medium at a re- 
cording medium output section 54, the recording medi- 
um can be provided to the customer. Alternatively, a re- 
cording medium prepared by the customer can be input 
to a recording medium input section 53, and, by writing 
the three-dimensional data, the recording medium can 
be provided to the customer. During this process, it is 
preferable to automatically identify the type of the input 
recording medium at the recording medium input sec- 
tion 53. 

[0087] Examples of the recording medium include a 
magnetic card, a card type memory, a floppy disk, a 
magnetic disk, CD-R/RW, and a security card for au- 
thentication. It is also possible to provide these record- 
ing media by mail or by a door-to-door delivery service. 
In such a case, it is preferable to send the data to a pro- 
viding section near the mail destination via a network, 
output the recording medium there, and mail or allow 
the customer to return and collect the recording medium 
at that location, because in any of these ways delivery 
costs can be reduced. 

[0088] Fig. 6 shows a flow of the recording medium 
or the three-dimensional data. 

[0089] A communicating section 61 of the three-di- 
mensional model providing apparatus includes a com- 
munication function section 62 of infrared and RS-232C, 
and transmits the three-dimensional data to the mobile 
terminal of the customer. Also, the communicating sec- 
tion 61 connects to a network via, for example, an Eth- 
ernet, a phone line, ISDN, satellite communication, or 
digital broadcast, and transmits the three-dimensional 
data to the destination designated by the customer. The 
destination that can be designated by the customer in- 
cludes a computer at home and a server on a network. 
The transmission method includes electronic mail and 
file transfer. When the data is to be accumulated at a 
server on a network by transferring an electric mail or 
file, the customer can receive, at the receiving section 
1 1 , identification information for identifying the customer 
when the customer accesses the server from his com- 
puter or mobile terminal 63, or such identification infor- 
mation can be issued at the providing section 1 4 and 
provided to the customer. 

[0090] Fig. 7 shows a flow of data such as the three- 
dimensional data and entertainment program when the 



provided three-dimensional data is used at various en- 
tertainment devices in a case where a game compatible 
format is designated at the data format receiving section 
40. 

5 [0091] Here, a target input by a customer, for exam- 
ple, a face or a body of the customer, or a character 
created by the customer can be input to a three-dimen- 
sional data input compatible entertainment device as a 
character for the game and play the game. The three- 

10 dimensional data is output by a method designated by 
the customer at the providing method receiving section 
42 or output by a providing method suited for connection 
configuration of the entertainment device. This configu- 
ration also enables fitting of the input three-dimensional 

is data into the unique input format of the entertainment 
device as a character by transmitting/receiving with a 
database server for managing the entertainment pro- 
gram or character data, and entertainment using three- 
dimensional data of the target input by an entertainment 

20 device other than the three-dimensional data input com- 
patible entertainment device by incorporating into the 
program itself. 

[0092] As a result of the entertainment at the enter- 
tainment device, the obtained score or the results and 

25 score can be transmitted/received with a three-dimen- 
sional model providing apparatus via a recording medi- 
um or a communication medium. By reflecting the ob- 
tained score or the like when the three-dimensional data 
is modified or changed, it is possible to improve the fun 

30 of the entertainment. For example, the character's face 
can be beautified or the muscles can be strengthened 
when a high score or good results are achieved. 
[0093] In addition, by providing in advance materials 
in the apparatus that can be processed and that are 

35 needed for creating a character, it is possible to provide 
data satisfying the customer's specific demands. 
[0094] Fig. 8 is a diagram showing a case where 
three-dimensional data is produced from two-dimen- 
sional image data of the target and then provided to the 

40 customer. The customer sends the two-dimensional im- 
age data obtained by capturing the image of the target 
for which three-dimensional data is desired from a two- 
dimensional image data input section 81 to a server sec- 
tion 82 via a recording medium or a communication me- 

45 dium such as a network, and inputs into the three-di- 
mensional model providing apparatus. The input two- 
dimensional image data is sent to a producing section 
83 where the three-dimensional data is produced. The 
three-dimensional data produced at the producing see- 
so tion 83 is provided to the customer at a providing section 
84. The producing section 83 can be connected to the 
server section 82 via, for example, a network where the 
transmitted two-dimensional data is displayed and a 
specialized operator can manually create the three-di- 

55 mensional data based on the two-dimensional image 
data, it is possible to realize an effective three-dimen- 
sional model providing apparatus by managing the 
transmission/reception of the data and the progress 



13 



EP1 163 940 A1 



14 



conditions for the operations of the producing section 
83 at the server section 82. 

[0095] Efficiency can be further improved when the in- 
put two-dimensional image data is an image captured 
in a condition where the data can be automatically con- 
verted into three-dimension, more specifically, a case 
where there are a plurality of images and the positional 
relationship between the cameras which captured the 
images are known, due to the possibility of automatic 
three-dimensional data production. 
[0096] Fig. 9 shows a configuration for realizing an in- 
tegrating function of the three-dimensional data accord- 
ing to another embodiment of the present invention. By 
selecting some of the three-dimensional data input at 
the input section (including the three-dimensional data 
provided by the customer) and from three-dimensional 
data registered in a database section, a plurality of 
three-dimensional data can be integrated when neces- 
sary and the integrated result can be confirmed at a dis- 
play section. For example, input three-dimensional data 
of a human head section provided by the customer can 
be integrated with three-dimensional data of a body 
wearing a piece of clothing preregistered in the data- 
base section. During this process, by changing some of 
the used three-dimensional data with a reference at one 
of the data size, integration with overall good balance 
can be achieved. 

[0097] As another example, input three-dimensional 
data of a human body with no cloth can be integrated 
with the three-dimensional data of a piece of clothing in 
order to simulate dressing. During this process, by al- 
tering the cloth data to fit the human body, or by altering 
the human body according to the characteristic of the 
cloth, it is possible to simulate trying-on of clothing. The 
three-dimensional data registered in the database not 
only includes clothes, but also ornaments such as glass- 
es and accessories, and styling elements such as hair 
style, makeup, and proportion. By selecting among 
these elements, the three-dimensional data can be ar- 
bitrarily modified. 

[0098] By providing the database section on a net- 
work so that it can be communicated with the other 
three-dimensional model providing apparatuses, the 
three-dimensional data can be managed at once, result- 
ing in improvements in efficiency, and thus, increase in 
the number of three-dimensional data that are regis- 
tered. By enabling registration and management of the 
input three-dimensional data at the database, the 
number of types can be further increased, resulting in 
more convenient configuration. 

"Structure of the three-dimensional data input section 
(image data input section and modeling section (refer to 
Fig. 2))" 

[0099] The data input section 20 captures an image 
of a target using a camera. In order to obtain three-di- 
mensional shape data, it is generally required to obtain 



a plurality of image data from a plurality of directions for 
one immovable target. It is therefore preferable to affix 
a plurality of cameras at predetermined positions and 
simultaneously capture images of the target. It is how- 
5 ever also possible to moveably mount a camera on a 
rail and obtain a plurality of image data by moving the 
camera. 

[0100] Reliable detection of the absolute positions of 
the plurality of fixed cameras are required, but in general 

10 this may be difficult with the mechanical means. To this 
end, as shown in Fig. 1 0, it is preferable to place a ref- 
erence object with a predetermined pattern drawn in the 
camera view and to perform calibration of camera posi- 
tion based on the image data of the reference object. In 

is this manner, the position of the camera can be accurate- 
ly detected with a simple mounting of camera, it is pref- 
erable to perform the calibration periodically, e.g. on dai- 
ly basis or on weekly basis. 

[0101] In order to accurately obtain the three-dimen- 

20 sional shape data of the target, each of the sections of 
the target must be seen differently from a plurality of di- 
rections. As shown in Fig. 11 , it is preferable to project 
a predetermined pattern onto the target using a projec- 
tor. In this manner, an accurate three-dimensional 

25 shape data can be obtained even for sections that have 
uniform colors or where color differences are small. The 
pattern can be removed from the color data by data 
process or, alternatively, the color data can be obtained 
from the captured data in a case where the pattern is 

30 not projected. As the projection pattern, a random pat- 
tern as shown in Fig. 12 can be preferably used. 
[0102] When three-dimensional data is obtained us- 
ing such a random pattern, a high-precision modeling 
can be performed even for the convex sections by ob- 

35 taining depth data using a stereo method with a plurality 
of cameras. 

[01 03] As the camera, it is preferable to use a camera 
with a wide-angle lens. This enables provision of the 
camera in a relatively small space. 
40 [0104] The data input section 20 captures an image 
of a target by a camera and extracts the target area in 
the image. It is therefore preferable to use a constant 
background color to facilitate the clipping of the target 
area. 

45 [0105] For example, it is preferable to provide a room 
with all four walls having a uniform color and place the 
target at the center section of the room. In particular, 
when the target is a person, it is preferable to provide a 
chair at the center section and let the person sit on the 

so chair. Also, in a case of a person, the image from the 
back side is relatively unimportant. 
[0106] Thus, it is preferable to provide an entrance at 
one wall of the room and let the person sit facing this 
entrance, while unifying the colors of the walls except 

55 for the entrance side. For a person, it is also preferable 
to omit the image data from the back side. 
[01 07] When the target and the background have the 
same color, the clipping becomes difficult. It is therefore 
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preferable to allow a change in the background color 
(the color of the room walls). For example, by projecting 
a light ray of predetermined color from outside using a 
projector, the wall color can be changed. 
[0108] Moreover, it is also preferable to change at 
least two colors in the background color, obtain image 
data at the two types of background colors, and clip the 
target area in the image by the sum of the extraction 
results at both background colors. In this manner, the 
target area can be reliably clipped for any target color. 
[0109] Furthermore, it is preferable to provide illumi- 
nation devices at the four corners of the room and light 
up the room so that there will be no shadow on the tar- 
get, in order to unify the illumination for the target. 

"Others" 

[0110] When a pet such as a dog is the target, it is 
necessary to restrain the pet. It is preferable to provide 
a chain at the image capturing station. In this case, by 
unifying the color of the chain and the background, it is 
possible to facilitate extraction of the target in the cap- 
tured image data. 

[0111] Fig. 13 shows a structure of a three-dimension- 
al data producing apparatus at an input section 10 ac- 
cording to another embodiment of the present invention. 
[0112] A light projection section 200 projects a ran- 
dom pattern, slit pattern, or coded pattern assigned on 
a panel 201 onto a target such as, for example, a person 
or a person's face. The projected pattern light is project- 
ed onto the target 203 after reflecting at a reflecting sec- 
tion 202. 

[01 13] The target image with the pattern light project- 
ed is captured at an image input section 204 such as a 
CCD camera and the three-dimensional data of the tar- 
get is produced at a modeling section 205 from a plural- 
ity of obtained images by the method already described. 
[0114] When the distance from the light source of the 
light projection section 200 to the target is small and the 
pattern is directly projected onto the target, there will be 
sections where the pattern is not projected due to the 
shadow of the target itself. In other words, there will be 
portions which cannot be seen from the light source. In 
the case shown in Fig. 14(a), the pattern is not projected 
onto a part of the neck due to the shadow of the chin. 
[01 1 5] Thus, the shape measurement of such part will 
either be very difficult or inaccurate. 
[0116] In order to minimize such possibility of a blind 
spot, the distance between the light source and the tar- 
get can be set at a sufficiently large distance, as shown 
in Fig. 14(b). However, this configuration will result in a 
very large overall size of the apparatus. 
[0117] Therefore, the projection pattern is projected 
onto the target after being reflected at the reflecting sec- 
tion 202. 

[0118] In this manner, it is possible to increase the dis- 
tance of the light path from the light projection section 
200 to the target while preventing the overall size of the 



apparatus from becoming large. 
[0119] It Is also possible to irradiate a laser ray in 
place of the pattern light from the light projection section 
200 as described above. A laser ray irradiating device 
5 has a basic structure as shown in Fig. 15. 

[0120] Specifically, a two-dimensional scan is ena- 
bled in the configuration shown in Fig. 1 5(a) by changing 
the progress direction of the beam-type laser ray using 
a galvano mirror or a polygon mirror. 

10 [0121] In the configuration shown in Fig. 15(b), a two- 
dimensional scan is enabled by changing the beam-type 
laser ray into a slit light by a cylindrical lens and chang- 
ing the progress direction of the slit light using a galvano 
mirror or a polygon mirror. 

15 [01 22] Even in the above-described cases, if the dis- 
tance to the target is insufficient, the problem of the blind 
spot will be generated, as also described above. There- 
fore, a method for increasing the light path using a re- 
flecting section is useful from the view of reducing the 

20 blind spots. 

[01 23] Similarly, problematic blind spots are also gen- 
erated during the input of an object with the pattern pro- 
jected. For example, as shown in Fig. 16(a), when cap- 
turing an image of a pattern -projected object using a 

25 CCD camera, it is not possible to input the portion of the 
neck that is blocked by the chin for the same reason as 
described above. As shown in Fig. 16(b), the distance 
from the camera to the target can be set at a sufficiently 
large distance using a lens with a longer focal length. 

30 However, this configuration will again result in a very 
large overall size of the apparatus. 
[01 24] Thus, the image of the pattern -projected target 
reflected at the reflecting section is captured by the cam- 
era. In this manner, it is possible to elongate the distance 

35 from the target to the camera while preventing the over- 
all size from becoming too large. This configuration can 
minimize blind spots. 

[01 25] Fig. 1 7 shows a structure of a three-dimension- 
al data producing apparatus according to another em- 

40 bodiment of the present invention. 

[0126] A plurality of data input sections 240 are 
present for capturing an image of a target from a plurality 
of directions and inputting image data. A data input sec- 
tion 240 includes an image input section 241 . As the im- 

45 age input section 241 , an analog or digital color CCD 
camera or the like may be employed. 
[0127] A portion of the data input sections includes a 
data input reference parameter determining section 241 
for suitably determining the parameters during the data 

50 input, such as, for example, white, balance, exposure, 
etc. 

[0128] Each of the other data input sections, on the 
other hand, includes a parameter setting section 243 for 
setting the parameters to the parameters determined at 
55 the data input reference parameter determining section. 
At these data input sections, images are input based on 
the set parameters. 

[0129] At a modeling section 244, three-dimensional 
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data of the target is calculated based on a plurality of 
images obtained at the data input sections. The mode- 
ling process can be performed by, for example, the 
method described in Japanese Patent Laid-Open Pub- 
lication No. Hei 10-124704. 

[01 30] The flow of the data input will now be described 
referring to Fig. 18. 

[01 31 ] The parameters such as the wh rte balance and 
exposure are automatically determined at one data in- 
put section (step S1 0). This can be easily accomplished 
using functions such as auto-white balance and auto- 
exposure which are commonly provided in electronic 
cameras. 

[0132] The determined parameters are then notified 
to the other data input sections (step S11). 
[0133] At each data input section, the notified param- 
eters are set at the internal parameter setting section of 
the data input section (step S12). In other words, at 
these data input sections, the parameters are not auto- 
matically set, but are set by the parameters notified from 
outside. 

[0134] The images are input at all data input sections 
based on the set parameters (step S13). 
[0135] In this manner, by setting the parameters de- 
termined at one data input section as common param- 
eters and by inputting images at all data input sections 
based on the common parameters, it is possible to input 
images with constant quality. 

[01 36] In contrast, if each data input section separate- 
ly sets suitable parameters, different values will be set 
as the suitable parameters due to the reasons such as 
(1) the sections of the target seen from each input sec- 
tion are different, and (2) the background sections (area 
other than the target area) seen from each input section 
are different. 

[01 37] Because of this, the color of one section, which 
should be constant from one data input section to an- 
other, will vary. This will pose a serious problem when a 
single set of three-dimensional object data is ultimately 
produced. However, by determining one set of reference 
parameters and using the reference parameters as 
common parameters, images can be input satisfying the 
condition that all areas of one section will have a uniform 
color. 

[01 38] Here, a case is shown where the reference pa- 
rameters are automatically determined at one data input 
section. It is also possible for an operator to decide the 
reference parameters. There are also cases where an 
operator wishes to set a more suitable set of parameter 
values other than the values automatically determined 
at the data input section, based on his experience or for 
a special effect. In such cases, manual setting is pref- 
erable. 

[0139] In the above example, a case is described 
where three-dimensional data of the target is created. 
The present method can also be applied for creating 
pseudo-three-dimensional shape data of the target such 
as QuickTime VR. Using the present method, a problem 
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where the hue changes when the target is rotated and 
displayed can be avoided. 

[0140] As described, according to the present inven- 
tion, three-dimensional data for a target can be automat- 
5 ically produced and provided with desired content des- 
ignated by a user. 



Claims 

10 

1 . A three-dimensional model providing apparatus for 
supplying three-dimensional data of a target to a 
customer, said apparatus comprising: 

15 an input section for inputting three-dimensional 

data; 

a server section for managing the three-dimen- 
sional data; 

a providing section for providing the three-di- 
20 mensional data; and 

a communicating section for communicating 
said three-dimensional data between said input 
section, server section, and providing section. 

25 2. A three-dimensional model providing apparatus of 
claim 1 , further comprising: 

a receiving section for receiving instruction 
contents from the customer; and 
30 a converting section for modifying, processing, 

or converting said three-dimensional data 
based on said instruction contents. 

3. A three-dimensional model providing apparatus of 
35 claim 1 , further comprising 

an output section for confirming, visually or by 
audio, the input three-dimensional data or modified 
or processed three-dimensional data. 

40 4. a three-dimensional model providing apparatus of 
claim 3, wherein said output section is capable of 
three-dimensional display. 

5. A three-dimensional model providing apparatus of 
45 claim 1 , wherein said input section produces three- 
dimensional shape data based on image data of the 
target captured from a plurality of directions. 

6. A three-dimensional model providing apparatus of 
so claim 1 , wherein said input section produces color 

data associated with said three-dimensional shape 
data based on image data of the target captured 
from a plurality of directions. 

55 j. A three-dimensional model providing apparatus of 
claim 1 , wherein said input section produces three- 
dimensional shape data based on image data of 
said target captured from a plurality of directions by 
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50 
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a plurality of cameras. 

8. A three-dimensional model providing apparatus of 
claim 1 , wherein said input section produces color 
data associated with said three-dimensional shape 
data based on image data of said target captured 
from a plurality of directions by a plurality of camer- 



9. A three-dimensional model providing apparatus of 
claim 1 , wherein said input section includes a light 
irradiating section for irradiating light onto said tar- 
get. 

10. A three-dimensional model providing apparatus of 
claim 9, wherein said input section comprises: 

a light projection section for projecting light; 
a light reflecting section for reflecting light inci- 
dent from said light projection section and pro- 
jecting onto the target; 

a light receiving section for receiving light pro- 
jected onto said target and reflected therefrom; 
and 

a modeling section for producing three-dimen- 
sional data of the target based on the received 
light data. 

11. A three-dimensional model providing apparatus of 
claim 9, wherein said light projection section is a 
surface light source for projecting a pattern light. 

12. A three-dimensional model providing apparatus of 
claim 1 , wherein said input section comprises: 

a light projection section for projecting light onto 
the target; 

a target image reflecting section for further re- 
flecting light projected onto said target and re- 
flected therefrom; 

a light receiving section for receiving the target 
image reflected at said target image reflecting 
section; and 

a modeling section for producing three-dimen- 
sional data of said target based on the received 
light data. 

13. A three-dimensional model providing apparatus of 
claim 2, wherein said instruction content from the 
customer received at said receiving section identi- 
fies a data format to be used when the three-dimen- 
sional data is provided by said three-dimensional 
model providing apparatus. 

14. A three-dimensional model providing apparatus of 
claim 2, wherein said instruction content from the 
customer received at said receiving section is mod- 
ification and processing contents to be applied to 



the three-dimensional data by said three-dimen- 
sional model providing apparatus. 

1 5. A three-dimensional model providing apparatus of 
claim 2, wherein said instruction content from the 
customer received at said receiving section is a da- 
ta providing method designating the providing 
method of the three-dimensional data by said three- 
dimensional model providing apparatus. 



10 



16. A three-dimensional model providing apparatus of 
claim 2, wherein said receiving section comprises 
a received content output section for outputting the 
instruction content from the customer and the iden- 

*5 tification information for identifying the customer. 

17. A three-dimensional model providing apparatus of 
claim 1 6, wherein said received content output sec- 
tion comprises one of a display-at-display section, 

20 an output-by-printing section, and an output-to-re- 
cording-medium section. 



18. A three-dimensional model providing apparatus of 
claim 13, wherein said converting section converts 
said three-dimensional data according to said data 
format. 

19. A three-dimensional model providing apparatus of 
claim 14, wherein said converting section modifies, 
processes, or converts said three-dimensional data 
according to said modification and processing con- 
tents. 

20. A three-dimensional model providing apparatus of 
claim 1 , wherein said server section manages op- 
eration progress condition of said providing section 
and said converting section, in addition to managing 
said three-dimensional data. 
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30 



35 



40 21. A three-dimensional model providing apparatus of 
claim 1 , further comprising a communicating sec- 
tion, wherein said apparatus communicates, via 
said communicating section, said three-dimension- 
al data, said instruction contents from the customer, 

45 and identification information for identifying the cus- 
tomer to/from another three-dimensional model 
providing apparatus having a function equivalent to 
said converting section. 

so 22. A three-dimensional model providing apparatus of 
claim 1 , further comprising a communicating sec- 
tion, wherein said apparatus communicates, via 
said communicating section, three-dimensional da- 
ta, the content of an instruction from the customer, 
and/or identification information for identifying the 
customer to/from another three-dimensional model 
providing apparatus having a function equivalent to 
said providing section. 
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23. A three-dimensional model providing apparatus of 
claim 1 , wherein said providing section comprises: 

a recording medium selecting section capable 
of selecting a recording medium from among 
one or more types of recording medium provid- 
ed to said three-dimensional model providing 
apparatus in advance; and 
a recording medium writing section for writing 
three-dimensional data onto the recording me- 
dium. 

24. A three-dimensional model providing apparatus of 
claim 1 , wherein said providing section comprises 
a recording medium writing section for writing the 
three-dimensional data onto a recording medium 
prepared by the customer 

25. A three-dimensional model providing apparatus of 
claim 1 , wherein said providing section comprises 
recording medium mailing means for mailing the re- 
cording medium. 

26. A three-dimensional model providing apparatus of 
claim 1, wherein said providing section provides 
said three-dimensional data to a providing section 
of another three-dimensional model providing ap- 
paratus via said communicating section. 

27. A three-dimensional model providing apparatus of 
claim 26 ( wherein said other three-dimensional 
model providing apparatus is a designated appara- 
tus designated by the customer. 

28. A three-dimensional model providing apparatus of 
claim 26, wherein said other three-dimensional 
model providing apparatus is a database server for 
managing access by the customer, in addition to ac- 
cumulating and managing said three-dimensional 
data. 

29. A three-dimensional model providing apparatus of 
claim 15, wherein said three-dimensional data and 
unique information of the customer are communi- 
cated to/from the designated apparatus based on 
said data providing method. 

30. A three-dimensional model providing apparatus of 
claim 29, wherein said designated apparatus is ca- 
pable of adding new information to said unique in- 
formation. 

31. A three-dimensional model providing apparatus of 
claim 29, wherein said designated device is an en- 
tertainment device. 



entertainment device and said new information is a 
score determined by the entertainment device as a 
result of the entertainment. 

s 33. A three-dimensional model providing apparatus of 
claim 30, wherein said designated apparatus is an 
entertainment device and said new information is 
information for updating the three-dimensional da- 
ta. 

10 

34. A three-dimensional model providing apparatus of 
claim 30, furthercomprising an information re-input- 
ting section for rereading the information with the 
new information added at said designated appara- 
15 tus. 



35. A three-dimensional model providing apparatus of 
claim 29, wherein said designated apparatus is an 
entertainment device and the three-dimensional 
data recorded in said recording medium is used by 
an entertainment program of said entertainment de- 
vice. 
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36. A three-dimensional model providing apparatus of 
claim 29, wherein said designated apparatus is a 
database section and manages the input three-di- 
mensional model and entertainment program. 

37. A three-dimensional model providing apparatus of 
claim 36, wherein said server section reads a model 
template of entertainment characters from said da- 
tabase section, and the input three-dimensional 
model is changed at said converting section based 
on said character model template. 

38. A three-dimensional model providing apparatus of 
claim 36, wherein said server section reads an en- 
tertainment program from said database section, 
and the input three-dimensional model is incorpo- 
rated into said entertainment program at said con- 
verting section. 

39. A three-dimensional model providing apparatus of 
claim 31 , wherein a plurality of said entertainment 
devices exist. 

40. A three-dimensional model providing apparatus of 
claim 31 , wherein said plurality of entertainment de- 
vices are capable of communicating with each oth- 
er. 

41 . A three-dimensional model providing apparatus of 
claim 27, wherein said designated apparatus is a 
device connected to a network including a compu- 
ter. 



32. A three-dimensional model providing apparatus of 
claim 30, wherein said designated apparatus is an 



42. A three-dimensional model providing apparatus for 
supplying three-dimensional data of a target to a 
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customer, said apparatus comprising: 

an input section for inputting two-dimensional 
image data; 

a producing section for producing three-dimen- 
sional data from said two-dimensional image 
data; 

a server section for managing said three-di- 
mensional data from input to output; 
a providing section for providing three-dimen- 
sional data; and 

a communicating section for communicating 
said three-dimensional data between said input 
section, producing section, server section, and 
providing section. 

43. A three-dimensional model providing apparatus of 
claim 42, wherein said two-dimensional image data 
is at least one portion of the image data of said tar- 
get. 

44. A three-dimensional model providing apparatus of 
claim 42, wherein said two-dimensional image data 
is image data captured in accordance with a method 
for automatically producing three-dimensional data. 

45. A three-dimensional model providing apparatus of 
claim 42, wherein said communicating section is ca- 
pable of communicating with an external network. 

46. A three-dimensional model providing apparatus for 
supplying a three-dimensional model to a customer, 
said three-dimensional model obtained by combin- 
ing at least two three-dimensional models, said ap- 
paratus comprising: 
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49. A three-dimensional model providing apparatus of 
claim 46, wherein said display section is a display 
apparatus capable of three-dimensional display. 

50. A three-dimensional model providing apparatus of 
claim 42, further comprising a communicating sec- 
tion capable of communicating with a database sec- 
tion via a network, wherein the three-dimensional 
model data is recorded in said database section. 

51 . A three-dimensional model providing apparatus of 
claim 46, wherein a plurality of three-dimensional 
model data recorded at said database section are 
read and the read three-dimensional model data 
are integrated to produce three-dimensional data. 



52. A three-dimensional model providing apparatus of 
claim 46, further comprising an optional function 
display section for allowing a customer to select an 

20 optional function. 

53. A three-dimensional model providing apparatus of 
claim 46, further comprising a three-dimensional 
data modifying section for modifying the input three- 

25 dimensional data based on said selected optional 
function. 

54. A three-dimensional model providing apparatus of 
claim 46, wherein said optional function adds a pair 

30 of glasses to the input three-dimensional data. 

55. A three-dimensional model providing apparatus of 
claim 46, wherein said optional function changes 
the hair style of or adds hair to the input three-di- 

35 mensional data. 



a database section capable of recording at 
least some portion of the three-dimensional 
model data; 

a controlling section for controlling the selection 
of three-dimensional model data recorded at 
said database section and the interface with a 
user; 

a data integrating section for integrating said 
selected three-dimensional model data; and 
a display section for displaying said three-di- 
mensional model data. 

47. A three-dimensional model providing apparatus of 
claim 46, wherein said data integrating section 
changes the shapes of at least two of the three-di- 
mensional models to be-integrated and then inte- 
grates the data. 

48. A three-dimensional model providing apparatus of 
claim 46, further comprising a color changing sec- 
tion for changing color of said selected three-dimen- 
sional model data. 



45 
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56. A three-dimensional model providing apparatus of 
claim 46, wherein said optional function assigns a 
color to a section of the model. 

57. A three-dimensional model providing apparatus of 
claim 46, wherein said optional function adds an or- 
nament to the input three-dimensional data. 

58. A three-dimensional model providing apparatus of 
claim 46, wherein said optional function changes 
the shape proportion of said three-dimensional 
model. 
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